OpensStack Compute 


Codenamed: Nova 


Nova Components 


Nova Components 


Nova Components 


Request Flow 
ASs 


API 


Scheduler 


Nova API Node 
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AP! Node 
Ags 


API 
Scheduler 


Messaging 
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API Node 


nova-apl Nova 


7 
—————————— 


¢eAn API Node is a machine running the nova-api service 


¢Serves as the primary gateway to Nova 
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API Node 


OpenStack 
AS a - 


| ece APL | API 


Nova 


eSupports the OpenStack API and the EC2 API 
eEC2 API is support for backwards compatibility 
¢The OpenStack API is preferred when possible 
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API Node 
2g a 


Nova 


¢ A Nova installation has one or more API Nodes 
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API Flow 
@ 


Pass Auth Token to Endpoint 


from Service Catalog along with 
Request Parameters 
= 
Compute API 


) 


Username 
Password 


Identity Service API 


@) 


Auth Token 
Service Catalog 
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On Top of the API 


Compute API 
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Nova Messaging 


Messaging 
AS) g 


API 
Scheduler 


Messaging 
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Messaging 


Nova ea i Nova penn 


RabbitMQ 


¢ OpenStack uses the RabbitMQ messaging platform 
eRabbitMQ sits between any two Nova components 
¢Allows components to be loosely coupled 
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Publisher 


Messaging 


Consumer 
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Topic 


Publisher 


Direct 


Consumer 


Invoker 
(e.g. api) 
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Messaging 


Topic 
Consumer 


key: topic 


Topic 
name: control_ exchange Consumer 


(type: topic) key: topic.host 


key: msg_id | 


Mame:msg id | 0 0 2.77 


(type: direct) Worker 


RabbitMQ Node 


(single virtual host context) 


(e.g. compute) 


openstack™ 


rpc.call le 


(topic.host) 
—_—_—_ 
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Consumer 


Invoker 
(e.g. api) 


essaging 


roc.call 


name: control_exchange 


(type: topic) 


key: topic.host 


key: msg_id 
name: msg_id 
(type: direct) 


RabbitMQ Node 


Direct 
Publisher 


Topic 
Consumer 


Worker 
(e.g. compute) 


openstack™ 


essaging 


roc.cast 


Topic 
Publisher 


name: control_exchange Consumer 


| 

| 

| 

| (type: topic) key: topic.host 
| 

| 

| 


ee ee J ee es pe eee 
Invoker 
(e.g. api) (e.g. compute) 
RabbitMQ Node 
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Nova Scheduler 


Nova Components 


Request Flow 
ASs 


API 


Scheduler 
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Scheduler 
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Scheduler 


AvailabilityZones 
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Filtering 
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Cost & Weights 


Nova Cells 


Where OpenStack is Headed 


Cells 


¢ A Nova deployment is called a Cell 


¢ A Cells allows you to partition your deployments 
into logical groups for load balancing and 
instance distribution 
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Cells 


Minimum Requirements for a Cell 
API Node ° API Node 


e Scheduler Node 


Scheduler Node 


e RabbitMQ 


RabbitMQ 


e« Database 


Database 
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A Complex Cell May Have 
¢ Multiple API Nodes 
e Multiple Scheduler Nodes 
¢ Multiple Network Nodes 
e Multiple Compute Nodes 
e A RabbitMQ Cluster 


e A Database Cluster 
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ntrusted Cells 


share Nothing 


Public 
OpenStack API 


API Node 


Scheduler Node 


RabbitMQ 


Database | . |W 


API Node 


Scheduler Node 


RabbitMQ 


Database 
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Cell Nesting 
“35 


Child A 
Child B 


Grandchild 
B1 


Parent |<t+ 


Child A 


Child B 


X- 


| 
Grandchild 
B1 
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Child B 
Grandchild 
B1 


openstack™ 


Request Processing 


an 2 ee —_———————— > Zone A 


———— 
————Y 


Zone 


Zone B 
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Cost & Weights 


nova.compute,api.create_all_at_once() 


Quantity=2 ae aaa 
cpu > 20% es se 

disk > 50G 

net > 10mpbs 2 | 78 | cab6297... | 
gpu = True mn 


Zone A 


2746abd... 
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Cell Capabilities 


General Capabilities 


e key=value;value;value, key=value;value;value 
e hypervisor=xenserver;kvm,os=linux;windows 
e --zone_ capabilities flag 
Dynamic Capabilities 
¢ Derived from nova.manager.SchedulLerDependentManager 


e set these capabilities by calling the 
update_service_capabilities() method on their 


Manager base class 
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Nova Network Node 


Nova Network 


Request Flow 


Be 
a 
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Nova Network 


Flat Manager 


Hypervisor 


— 
eo) 
2 
> 
— 
o 
(ea 
> 
ac 
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Nova Networ 
Flat DHCP Manager 


Nova Network 


Hypervisor 


= 
ie) 
D 
e 
(<b) 
[ok 
> 
x= 
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--public_interface=ethO 
--flat_interface=eth1 
--fixed_range=10.0.0.0/8 

--floating range=99.99.99.128/25 
--flat_network_dhcp_start=10.0.0.2 


etho 
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Nova Network 
Flat DHCP Manager 


public switch public/floating traffic 
dhcp traffic 


99.99.99.0/24 opuona 


99.99.99.128 
99.99.99.2 ethO 99.99.99.1 ethoO 


etwork 
eee 


192.168.0.2 eth1 192.168.0.1 
10.0.0.1 


192. 168.0. 0/24 
10.0.0.0/8 


private switch 


eth1 192.168.0.3 


/ 10.0.0.2 


vm 
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— 
fe) 
= 
> 
— 
o 
or 
> 
ae 


Hypervisor 


Nova Network 
VLAN Manager 


q Nova Network 


10.0.0.1 
a 


tag 
ethx.101 


tag 
ethx.101 


tag 
ethx.102 


openstack™ 


Nova Network 
High Availability Manager 


--public_interface=ethO 


i public/floating traffic 
--flat_interface=eth1 public switch 


dhcp traffic 
--fixed_range=10.0.0.0/8 
--floating_range=99.99.99.128/25 99.99.99.0/24 
--flat_network_dhcp_start=10.0.0.2 
ethO ethO 99.99.99.1 99.99.99.3 


nova-compute 
nova-network 


192.168.0.2 eth1 
10.0.0.2 


nova-compute 


/192.168.0.3 
/10.0.0.4 


‘ 10.0.0.5 


192.168.0.1 eth1 
10.0.0.3 


192.168.0.0/24 
10.0.0.0/8 


private switch 


vm 
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Nova Network 
Floating IP’s 


75.15.6.7 


75.15.6.3 


75.15.6.5 75.15.6.4 
75.15.6.8 


75.15.6.6 
euca-disassociate-address 


euca-allocate-address 75.15.6.9 


euca-associate-address nova-network 
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Nova Network 
Floating IP’s 


nova-manage floating create --ip_range=10.0.2.0/24 


euca-allocate-address 
euca-associate-address -i i-COOOQO0007 1|0.0.2.3 
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Nova Network 


security Groups 


AS 


Security 


Nova Network 


security Groups 


e Create a new security group 
e euca-add-group —d “my servers” myservers 
e Add rules to the security group 
e ssh 
e euca-authorize —P tcp —s 192.168.1.1 —p 22 myservers 
e Ping 
e euca-authorize —P icmp —s 192.168.1.1 —t -1:1 myservers 
e Boot an instance into the security group 


e nova boot —flavor 3 —image 3 —ipgroup myservers <name> 
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Nova Compute Node 


Node 
a Compute 
Nov 


Request Flow 


AS 
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Nova Compute Node 


nova-compute 


Hypervisor 
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Nova Compute Node 


nova-compute 


LibVirt 
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Nova Configuration 


Nova Configuration 


e Flag File @ /etc/nova/nova.conft 


e All Configuration options: nova-manage config list 
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Exercise O 


Accessing the Classroom Cloud 


Accessing the Classroom Cloud 


» Divide into Teams 

» Training Lab WiFi Network 
» SSID: openstack 
» Password: openstack 


» Lab Nodes 


» 192.168.2.<your team number> (example: 192.168.2.1 1) 


» username: openstack 
» password: openstack 
» Shared nodes = one operator at a time 
» Resist temptation 
» please don't hack the nodes belonging to other teams 


» try to stay with us and not jump ahead too far 
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Accessing the Exercises 


» Exercises will be available at: 


hetp://192.168.2.1/nova/ 
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Exercise 1 


Nova All In One Installation 


Tne Nova Filesystem 


The Nova Filesystem 


/var/lib/nova/ 
nova-api.log - —— buckets 


t——— nova-compute.log | oa 


t—— nova-dhcpbridge.log | EALeHSIOnS 
'—_ nova.conf |} images 


[——— nova-manage.log 
| | instances 
nova-network.log 
t+—— nova-objectstore.log | keys 
t+——— networks 


Es 
| nova.sqlite 
[ 


/var/log/nova/ 
/etc/nova/ 


__— api-paste.ini 
t+——— nova-compute.conf 


nova-scheduler.log 


tmp 
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The Nova Filesystem 


/var/lib/nova/CA/ /var/lib/nova/extensions/ 
cacert.pem t—— admin -> /usr/share/pyshared/openstackx/admin 


alae t——— admin.py 
[/—— erl 


| aclpen [——— api -> /usr/share/pyshared/openstackx/api 

|___. index.txt t——— auth -> /usr/share/pyshared/openstackx/auth 

IL——. index.txt. attr | compute -> /usr/share/pyshared/openstackx/compute 
[—— index.txt.old t— extras -> /usr/share/pyshared/openstackx/extras 
t——— INTER L—__init__py 


t+——— newcerts 

| 4 |0.pem 
t—— openssl.cnf 
[-—— private 
—— 
t——— reqs 
t—— serial 


a 


cakey.pem 


serial.old 
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The Nova Filesystem 


/var/lib/nova/instances/ /var/lib/nova/instances/_base 
[-—— _base t—— 0000000 
| —— instance-00000005 -—— 00000002 
L___ in tance-00000007 I+—— |b6453892473a467d07372d45eb05abc203 | 647a 


I——  77de68daecd823babbb58edb | c8e 1 4d7 106e83bb 
t——. 77de68daecd823babbb58edb | c8el 4d7106e83bb_sm 


'__ local_40 


/var/lib/nova/instances/instance-O0000005/ /var/lib/nova/instances/instance-O0000007/ 
t—— console.log t—— console.log 
IL—— disk IL—— disk 
I—— disk.local It———. disk.local 
I—— kernel '—__ |ibvirt.xml 
IL—— |ibvirt.xml 
|____ pamdisk 
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Troubleshooting 


Nova Troubleshooting 


e/var/log/nova/nova-*.log 
*ps -aux | grep nova 
evirsh 

ebrctl 

erabbitmactl 

esqlite3, mysql, psa 
*euca-get-console-output 


Nova CLI 
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actions 
add-fixed-ip 
boot 

delete 
diagnostics 
flavor-list 
image-create 
image-delete 
image-list 

list 

migrate 
pause 
reboot 
rebuild 


remove-fixed-ip 


rename 
rescue 
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Nova CLI 


Nova 


Retrieve server actions. 

Add new IP address to network. 

Boot a new server. 

Immediately shut down and delete a server. 
Retrieve server diagnostics. 

Print a list of available ‘flavors’ (sizes of servers). 
Create a new image by taking a snapshot of a running server. 
Delete an image. 

Print a list of available images to boot from. 

List active servers. 

Migrate a server. 

Pause a server. 

Reboot a server. 

Shutdown, re-image, and re-boot a server. 
Remove an IP address from a server. 

Rename a server. 

Rescue a server. 
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resize 
resize-confirm 
resize-revert 
resume 
root-password 
show 

suspend 
unpause 
unrescue 
zone 
zone-add 
zone-boot 
zone-delete 
zone-info 
zone-list 

help 
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Nova CLI 


Nova 


Resize a server. 

Confirm a previous resize. 

Revert a previous resize (and return to the previous VM). 
Resume a server. 

Change the root password for a server. 

Show details about the given server. 

Suspend a server. 

Unpause a server. 

Unrescue a server. 

Show or edit a child zone. No zone arg for this zone. 
Add a new child zone. 

Boot a new server, potentially across Zones. 

Delete a zone. 

Get this zones name and capabilities. 

List the children of a zone. 

Display help about this program or one of its subcommands. 
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account 
agent 


config 


drive 

fixed 

flavor 
floating 

host 
instance_type 


image 


Nova CLI 


nova-manage 


version 
volume 


vpn 


vSa 
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Openstack Image 
service 


Codenamed: Glance 
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Original 


im-age 
n. 


1. Areproduction of the form of a person or object, especially a sculptured likeness. 
2. One that closely or exactly resembles another; a double: 
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Glance 


Image Metadata 


openstack™ 


Glance 


Z|» 


Image Metadata 


New Instance 


im-age 
n. 


1. Areproduction of the form of a person or object, especially a sculptured likeness. 
2. One that closely or exactly resembles another; a double: 


67 openstack” 


Tuesday, October 23, 2012 


Glance 


Apa 


API Server 
Registry Server Store Adapter 


<a ee > Re 
S3 


Swift Filesystem HTTP = 
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Glance 


Image Identifiers 


Images are uniquely identified by way of a URI that matches the following 
Signature: 


<Glance Server Location>/images/<ID> 


The resource location of The image’s identifier that is 
the Glance service unique to that Glance server 
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Glance 
Image Registry API 


http://<glance server location>:9292/v1 


GET /images Return brief information about public images 
GET /images/detail Return detailed information about public images 
HEAD /images/<ID> Return metadata about an image in HTTP headers 


POST /images Register metadata about a new image 
PUT /images/<ID> Update metadata about an existing image 
DELETE /images/<ID> Remove an image's metadata from the registry 


Image registries are any web service that adheres to the Glance REST- 
like API for image metadata. 
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Filtering Image Lists 


name=NAME 

container format=FORMAT 
disk format=FORMAT 
Status=STATUS 

Size min=BYTES 


size max=BYTES 


sort _key=KEY 


sort dir=DIR 
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Filters images having a name attribute matching NAME. 


Filters images having a container format attribute matching FORMAT 


Filters images having a disk format attribute matching FORMAT 


Filters images having a status attribute matching STATUS 


Filters images having a size attribute greater than or equal to BYTES 


Filters images having a size attribute less than or equal to BYTES 


Results will be ordered by the specified image attribute KEY. Accepted values 
include id, name, status, disk format, container format, size, created at 
(default) and updated at. 


Results will be sorted in the direction DIR. Accepted values are asc for ascending or 
desc (default) for descending. 


open 


= { 
. “=I, i 
> at J , i . | ~% 


POST /images 


{'image': 
{'id': <ID>|None, 
‘name': <NAME>, 
'status': <STATUS>, 
‘disk format': <DISK FORMAT>, 


‘container format': <CONTAINER_ FORMAT>, 
‘properties': [ ... ] 


} 


* status must be non-empty, and must be one of active, saving, queued, or killed 
e disk format must be non-empty, and must be one of ari, aki, ami, raw, iso, vhd, vdi, qcow2, or vmdk 
* container format must be non-empty, and must be on of ari, aki, ami, bare, or ovf 


e If disk format Of container format is ari, aki, ami, then both disk format and container format must be the same. 


- 
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Glance 


Image Statuses 


Adding Images 


Killed 


Removing Images 


Pending 
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Glance 


Disk Formats 


raw This is an unstructured disk image format 
This is the VHD disk format, a common disk format used by virtual machine monitors from VMWare, 


Xen, Microsoft, VirtualBox, and others 


Another common disk format supported by many common virtual machine monitors 
A disk format supported by VirtualBox virtual machine monitor and the QEMU emulator 


An archive format for the data contents of an optical disc (e.g. CDROM) 

qcow2 A disk format supported by the QEMU emulator that can expand dynamically and supports Copy on 
Write 

aki This indicates what is stored in Glance is an Amazon kernel image 

ai This indicates what is stored in Glance is an Amazon ramdisk image 

ami This indicates what is stored in Glance is an Amazon machine image 
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Exercise 2 


Glance Installation & Image Loading 


Exercise 3 


Boot Instance 


Openstack Identity 
service 


Codenamed: Keystone 


Keystone Concepts 


User 


Authentication 
Endpoint 


Service 


Tenant 
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Keystone Concepts 


System 


Keystone Concepts 


Credentials 


Keystone Concepts 


Authentication 


Keystone Concepts 


Token 


Keystone Concepts 


Tenant 


Keystone Concepts 


Service 


Keystone Concepts 
Endpoint 


Keystone Concepts 


Role 


_—— 


¥. 


Keystone 
Populating Auth Data 


Add Tenants 


ekeystone tenant-create --name My Tenant 
ekeystone tenant-list 


Add Users 


ekeystone user-create --tenant_id <GUID> --name myuser --pass mypassword 
ekeystone user-list 


Add Roles 


ekeystone role-create --name Admin 
ekeystone role-create --name Member 
ekeystone role-list 


Grant Roles 


ekeystone user-role-add --user <GUID> --tenant_id <GUID> --role <GUID> 
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Keystone 
Populating Auth Admin Data 


Keystone Service Admin 


ekeystone service-create --name=keystone --type=identity --description="Identity Service" 


Endpoint Templates 
ekeystone endpoint-create --region RegionOne --service_id=<GUID> --publicurl=http:// 
|27.0.0. 1:5000/v2.0 --internalurl=http://127.0.0.1:5000/v2.0 --adminurl=http://127.0.0.1:35357/v2.0 


Add Tokens 


ekeystone-manage token add 999888777666 myadmin My Tenant 2015-02-051T00:00 


Add Credentials 


ekeystone-manage credentials add admin EC2 admin:admin mypassword My Tenant 
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Exercise 4 


Keystone Installation & Setup 


Openstack 
Dashboard 


The OpenStack Web Interface 


Exercise 5 


Dashboard Installation 


Demo 


A Dashboard Walkthrough 


Packages for Labs 


deb http://ops.rcb.me/packages maverick diablo-d5 
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Resources 


htto:/Awww.openstack.or 


https :/Aaunchpad.net/openstack 


https ://github.com/openstack 


https://github.com/cloudbuilders 
http://www.referencearchitecture.org/ 
http://devstack.org/ 
http://programmerthoughts.com/ 
http://www.unchainyourbrain.com 


http://www.tlohg.com 
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Tony Campbell 


tony.campbell@rackspace.com 
@tonytcampbell (twitter) 
+Tony Campbell (google+) 

1 210-312-4150 


John McKenzie 


john.mckenzie@rackspace.com 
@jmckind (twitter) 

+John McKenzie (google+) 

1 210-312-4667 


Byron McCollum 


e byron.mccollum@rackspace.com 
¢ @bgmccollum (twitter) 


e 1 210-312-4204 


Appendix 
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ova & VMWare 


Glance HTTP Server 


HTTP GET | | HTTP POST 


nova.compute 


SOAP HTTP PUT HTTP GET 


-VMDK 
VMware ESX Server aa 


ESX API Server ESX HTTP Server 


http://nova.openstack.org/vmwareapi_readme.html 
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